This is and academic project developed for the subject “Real-Time Interaction” from the master in Cognitive Systems and Interactive Media. We wanted an abstract representation of the 4 elements – earth, wind, water and fire. We created an application that mapped the hands and the knees to one of each element.
We used kinect to recognize the skeleton of the user to first generate the graphics shown in the image. The starting point for each set of lines corresponds to the position of the hands and the knees. Furthermore, the color of each set of lines corresponds to one of the 4 elements. We used Processing to program the behavior of the graphics.
Also, for the sounds, we chose representations of each element and we mapped them with the movement of the body. Using Pure Data we generated different effects for each element that affected the sounds depending on the speed, acceleration and direction of the movement of the user.
This project was developed with Lola Barreto and Wipawee Kongsantad
